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'abstract 

The results of this study reveal the sources of 
infurmaticn apt to go into an information system fox education. As 
part of a national study of the research and developioent (RSD) 
capa.city of schools^ colleges^ and departments of education (SCDEs)^ 
indices of productivity for such units were derived on six variables: 

(1) the number of articles credited to faculty members in education 
over a three-year period in 26 journals selected as core 
publications;, (2) the number of documents deposited. in the RESOURCES 
IN EDUCATION pcxtion of ERIC over a two-year period; (3) the number 
of books in education reviewed in the 26 journals already mentioned; 

{^) the number of papers read at the national conventions of six 
professional societies in education over a three-year period; (5) the 
number and dollar aiBCunts of . foundation grants for education research 
and development over a three-year period; and (6) the number and 
dollar amounts of government grants and contracts for educational R&D 
for a 21-month period. These data were tallied for as many of the 
1,367 SCDEs as made contributions and/or received grants and 
contracts. It was determined that SCDEs. contribute approximately 40 
piercent in most of the above areas and 56 percent in journal 
articles. However, only one out of five SCDEs contributed to the 
total educational RSD performance as measured by these six variables. 
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As part oE a naLional study of the- R&J) capacity oE schools , . colleges , 
.and departments of education (SCDEs), we undertook to derive indices of pro- 
ductivity for such units on six variables: (1) the number of aVticles. cre- 
dited to' faculty members in education over a .three-year period in twenty- 
six journals selected as core or near-core publications; (2) 'the number - 
of documents deposited in the Resources in Education (RIE) portion of ERIC 
over. a two-year per iod ; - (3) the number of books in education reviewed in 
the 23 journals already mentioned; (4) the number of papers read at the 
national conventions of six, professional societies in education over a 
thre4-year period; (5) the^ number and dollar amounts of foundation grants 
■for educational R&D over a three-year period; and (6) the number and dollar 
amount of government ■gr'gnts and contracts for educational R&D for a 21 -month 
period'., Tliese data were' tallied for as many of the 1,367 SCDEs as made, con- 
tributions and/or received grants and contracts. 

It was our hope to use these several indices to derive an overall ' 
indicator of R&D productivity for each institution. Mien the data were 
finally accumulated, however, we were overcome by the magnitude of the task, 
especially since there appeared' to be very wide variation among the several 
types of- institutions which we had defined a priori . Finally, almost in 
desperation, we determined to attempt the formulation of a' series, of rules, 
each of. which wolild success iyeiy eliminate so'me portion of the- population 
from further cons idera tion^as ■.an '^ For this purpose we did not 

uttUze book and convcnt-^on da ta ■, however , since very often we had been un- 

ahle to, determine departmental aff ilia t/lon . for authors, 

' . ,' ■' ' ' ' / 

We began with a /simple rule that would eliminate' institutional non- 

■ , ■ ' \ ■ ■ . ' 

producers, viz.: / 



• . 1. Non-producers are^SCDEs which accumulate no credits in 
.an3' oE the four criterion areas. 

To our surprise, this rule eUminated from further consideration ' 
773 of the SCDEs in the populat ion--56: 5 per cent of the total of 1,36.7. 
More than half of all SCDEs were not found to make any contribution what- 
ever] 

' ' Next,, we tried to eliminate those institutions in which it was clear. 

that the ..contribution must have resulted from the idiosyncratic, unsupported 

efforts oE a singie faculty member--what we have come to call an idiographic- 

contribution...^How could one state a rule that would unequivocally guarantee 

that no rri'l^^re -.than one person could have been involved? ' . ' ■ 

/ ■ ■ ' .__ • 

2. /Low_Producersj:J^i^ are SCDEs' with no grants or . 

■ contracts for R&D projects and with no more than 1.0 
credits in either journal publications or RIE. 



This rule elimina ted an additional 204 ins t i tut ions— anotlier 14.9 per 
cent o£ the total. ■ i . ' ' 

Next, we determjned to state' a rule which would separate- out instttu- 
t ions in which R&D prodiiction was probably still the id iographic -result of 
one man's efforts, but Ln which some institutional interest in :or sanction ■. 
for such activity was indicated. The rule: 



/ 
/ 

i 



.3. Low Producers--Min imal are SCDEs with a single grant, or 
/ contract for R6cD activity , in' which there was no more 
. 1' than 1.0 credit in either journal publications or RIE. 



The productivity in these institutions was still idiographic but . 
the presence of a grant or- contract indicated at, least -an institutional 
willingness to have one member oE its faculty engage inR&D. 

This rule culled out another 35 SCDEs or 2^56 per cent oE the pbpu- 



lation, 



"Finally, in dealing with low producing- institutions, we devised a 
rule, that would permit more than one faculty memb^er to be involved hx^t which . 
would still indicate a level of productivity which we felt that most obser- 
vers would classify unambiguously as low. Institutions ' were admitted to this 
category whether ov not they. had a grant or contract (they never had mere 
than one) so long--as they accumulated a multiple entry--gt-ea ter than 1.0-- ' 
■in either journals^or RIE. .To insure that the category did indeed represent 
a low .producing type, however,- it was stipulated that the multiple entry had 
to 'be in either journ^s or RIE but not both. The rule -is: 

4. .. Lol^^roduC£rs-^c^ are SCDEs with z-^ro or one grant 

or contract for R6J) activity in which the credits for 
either journals or RIE was zero and the credits in the 
other category -did not exceed 3.0. 

ITiis rule excluded another 94 ins ti tut ions--6 . 9 per. cent of the to- " 
tal. ■ . ■ ■ 

T\\e categories 'in the system so^far ranged from no evidence of R&D 
yield to au SCDE with one grant or contract for R&D activity and 3.0- credits 
in either- journals -or RIE. hesitated to go above this level in describ- 

ing low institutional productivity since the danger arises of penalizing 
smaller institutions s imply because they have few faculty members in the SCDE.' 
At this level of productivity, however, we felt that most^observers would 
agree that these SCDEs were contributing little in the R&D arena in education 
Th^ rules were having a remarkable effect on the population of 1,367 SCDEs, ' 
however; 1,106 had already been classified by applying just these four rules. 

We then turned our attention to the other, end of ' the cont inuum. unio, 
ve asked, are the high producers? Again, it seemed useful to distinguish 
among levels of high productivity. ': At the highest- level, we felt, should be 



in R&D 



ion 
our-" 



Pl-ccd .hc=. I„.,uu.i6„. .„a. d».„„..„„ p,„,3,,„, involve...^ 

docu„„, submission „e £eU, shouM be Ugh, .be' i„s»tu. 

nals sinco this (oo, I5 a reasuro o£ quilltv as os=„..„; v ' ' ' \ " 

K. H^cii, LLy as assessed by peers irijthV-' 

field-the journai eJlitors and referees' Th„,\-- c ■, , ■ 

ri-terees. Thus tne following rule evolved: - 

5. Hlsh_Producers^lliD Centers ore senps ,.„■ ,-1, f ■ 

grants or co^E^^^rrr^-STH , H '^'"'^ °' ""e 

o£ $750,000 of , ore/or Juh ",7-'r '""""'"S ■ 

for^«.„ a.,ivu. Pius°f i"j;or:^ie^':,f"ts"irtb:M=".= 

■ ,.^:"s ^or„:J:^:;id"L°In"""^''1 • • ■ 

n,ore credits In RK. . Journa Is 'plus 25 or " ■ 

In sharp, contrast to the first lo„-prod„eer rule „b Ich enabled 773 • 
institutions tobe l„edlatel, classified, this hlgb-producer rule ' l„c luded 
only 2« lnstltutlons-1,8 per cent of tbe total-dcsnlte Its ™dest 

men . ' \ > 



A second ,.oup .„.s .den..f,ed as ou.....a.n. prokce^s. X, e...,.,., 
«.e,„nie oe p.o.uc..vU.,. .as apparent .... .^ .as a group o. ..s.Uu 
.ions w,Uch.was pers,s.en. in accumulating credits across the measures or 

so outstanding on one Criterion ar.. that the institutional co..it.ent 
to R&p seemed undeniable. The rule governing this category is: - • . - 

R^n n^^^T ' SVants orTantracts for 

... P-duc.t,v.ty totaling funds of $250,000 or more 

. or 25 journal credits in the- "core',' journals- or W s 

or more journcTl credits nine: 19 c, " J^^^nais,. or 17.5 
.RIE. ' 'i- creaits plus 12. 5 or more cred its . in. 



This rule enabled the. class if ication of another 3.6 ins ti tut ions- - 
2, 6, per cent of the total. 

k final group of high producers^vas definea- which, while exhibiting 
multiple, credits', usually^also e^^hibited low productivity per faculty mem- 
b<5r.. The rule is: . ' , ■ 

^ liiSk_lloduce_rs---R&D Actives are SCDEs with multiple grants 
or contracts for R&D activity . totaling $100,000 or more;- " 
or 15 or-more credits in V'pore^V journals ; or 10 or'more 
credits in jojurna Is plus 7.5^^^ more RUil credits. 

.This rule classified an additional 39 ins t i tut ions--2 . 8 per cent ' 
,of the total. ■■ 
nlroughout • the fir^t seven, categories, an effort was made. to avoid 
the question, af SCDE size in relation to R&D yield. The target of our study 
was theSCDE.as an institution, not the; faculty member ,as an individual. 
..The low producers are so low that most observers would probably be content- ■■ 
t6\ignore the si^e of the institution as a significant variable^.^,- At' the, 
othei> .^extreme, categories s ix and seven are' so active that it seems' reason- 
'Tble to classify them- as high producers even if 'they have large faculties. > 
However, there were 'some .institutions with unusua I -^y ield profiles in whipli 
small size obviously affected^the institutions abilities to break into ' 
the high producer category. So as not- to' lose sight of these SCDEs a cate- 
gory of unusual producers was formed. Tlie'^lrule was 'as follows: 

8. Unusual Pr oduce rs are SCDEs "in cnr-egnrfoQ yit:b gmnll med- 
• ian faculty s ize in which-' the level of R6cD' activity in 
..the criterion areas -was so high tha t the ; institutions 
would have been qualified under rules f ive , -slxf^br seven 
above with the application of a size correction of\ c irca 
^ 50 per ^cent of a true size correction; or an SCDE in a -.7 

'./^ category with typ'icaUy low R&D activity which was ^ro- ' 
.ducing at a rate several times that of the category.^ 



Unfortunately, only 26 ins titution^ o-r 1.9 per cent :were helped by 
this definition. „ ' 

The remaining SCDEs were classified as. middle range producers, the 

level of R&D activity necessary to qualify for this category is quite low - 

despite that title. In an absolute sense many observers would probably be ' 

more comfortable in classifying these SCDEs as low producers, but in a 

relative sense these SCDEs are very competitive. The rule: ■ 

^* Ml.ddle Ran^e Producex^s are SCDEs not covered by any of 
eight rules enumerated previously. 

Some 136 SCDEs-10.0 per cent of the .total-.were assignedfby this 



rule, 



The genera! results of this mode of classification of the. R&D pro- 
ductivity of^SCDEs in shown in the handout' Table .1 . The categories ^defined . 
byv.the. nine rules which have been described form the basis for the columns 
of the table; the rows are defined in terms of an a priori c lass if icat ion 
system' based upon the degree level (doc tors , -masters , baccalaureate)' and the 
control (public, private), of the. institutions. Several summary observations 

may be made from 'this table: - 

. ''i^. ' - 

1/ Only 24 institutions qualify as R6cD Centers; all are doctoral 
: level institutions. - . 

2. Institutional commitment to educatlOiial' R&D Is very muqh a 
doctoral level, phenomenon. ^^JlUle 58. 9 per cent of doctoral- 
' Institutions are classified in one or another of the high 
■ . producer or unusual- producer categories , but 6^*0 per. cent 

of the masters institutions and 0.7 per cent of the bacca- \ 
^ laureate institution are so classified. Conversely, only 

. 1.3. per cent of doctoral institutions are classified as 
. - ' 'non-producefs, but 40.7 per cent of the masters ins titutlons 
77*8 per cent, of the,- baccalaureate institutions are so-^^. 
class if ied. 



.3. For all practical purposes, the number of institutions serious- 
ly committed to liSi) is limited to the 125 institutions, whatever 
their aegre.e level may be, that fall into the high producer or 
unusual producer categories. 

..4. The 26 institutions classified into the unusual producer cate- 
gory fall at all degree levels, indicating that there are proto- • 
types at all such levels of R&D committed institutions which 
might serve as useful models for other institutions in their 
categories with R&D aspirations. 

5., The total number of institutions engaged in educational R&D 
activity is small. 'rb.e bottom end of the middle range pro- 
ducer category is already beyond the 80th percentile ;. the 
total of R&D Centers, Other Outstanding Producers, and R&D 
Actives accounts for less than 7.5 per cent of the total. 

^^mether or not the depiction of educational R&D activity within ; 

SCDEs that is portrayed i'n Tablf ] is seen in a positive or negative light 

.depends U.rgely on the expectations one has for such activity in all types • 

of. SCDEs. If R&D activity is believed to be normative for SCDEs', the picture 

of Tab^le 1 appears. rather dismal. More than four in. five SCDEs are nearly. 

uninvolved in R&D. Given the low level of the criteria posed for institutions 

to be classified in at least the middle range producer cate^'bry, one might ' 

•have expected a larger propor tion ^to have accumulaeed at least some credits. 

Two grants (even of a few hundred dollars each), two journal credits, a com- 

bination of one journal credit and one RIE.'credit, or a total of four RIE 

.credits were sufficient to classify an institution as middle range. Surely 

one cannot be enthusiastic about such low level performance. 

But the. data also make " i t rather clear that most institutions do not 

acknowledge educational R&D among .their missions, and do little if anything 

to support such activity , institutionally; If we may accept the 125 institu- 

tions in the high or unusual producer categories as representing our best ; 

estimate of institutional involvement, we. begin to see a. picture among SCDeV 

not substantially different from, that in other professional areas. It seems 



•Ukeli^-that there are a^out 100-150 good medical, dental, legal, ^etc. schoo 
in the country that might be expected to take an active interest, in the R&D 
characteristicof those fields. It should not surprise us- to discover that 
a Similar situation holds foV sCDEs." Indeed, it is probably a good thing 
that there are not more active, competitors for the limited R&D dollars, 
staff, and programs than exist within these 125 institutions. 

„ One should not leap to the conclusion that the -125 SCDEs, that have 
selected R&D as aimiss io"n are performing at their op t imum' capabil i ty, how- ^ 
ever.- Among the select institutions characterized in this' study as R&D 
.Centers, for example, it requires two facul-ty members working for a total. ' 
of. three years to. produce one journal -credit; about , four -facul ty .working 
for three years fio^ "produce one RIE entry; and up .to 25 faculty (in the 
■ ■ public institutions) to, result in one foundation grant every three years 
or one government grant every 21. months. Inst i tut ions ' that .profess to de- 
vote substantial resources to R&D ac tivity .probably cannot yet afford to 
rest on their laurels. 

A__C gmparison with S ome_nHTPir_^,iT-cog 
Each, of ^he Voduc tivity studies was designed to provide data not ■ ; 
only about the yield from SCDEs but also about ao variety of other educa- . ' 
tibnal : R&D producers within and outside the University setting. Gompara- 
tive data will be presented that contrast SCDEs with th^'ee other majW 
categor'ies, viz.: 

1, Other University units, including, l^or example, human devel- 
. opment, psychology, political science, sociology, and health 

science departments; non-academic units such as the Presi- ' ' 
, dents Office or->Student Services Office; and all . others spe- 
V cifically reported in the- source documents. - 

elementary and secondary schools, state departments of edu- ' 



catidh\ profit and non-profit R&D units V r 
-tness and industry, and the 1 ike . • ' Government, bus- 

3. All foreign sources, including foreign SCDEs. 

In most, instances, it was found that some entries couIh' ^ 

encri.es could not unequi- 
vocally be associated with a i a 

a particular department or unit if the author ' 

represented a university. Th is was espec ially true of boo, 

H cta.i.y crue ot book and convention 

credits, in which large numbers of "Universitv UnH^ • 

-->• "^^^^^'^y l^ndesLgnatcd^' credits were 

SOOE. a„a „„„.SCOH, .3u,.„3.tH.. .... „..e d... ...... ' ' 

same ratio as were known credits of whioh t-K 

. . . d.t^, of wh.ch there was always an appreciable 

number usuable as a. base for projection: ' The dat. . u 

ine data to be presented have been 

adjusted usin'g this procedure, • 

; The basic findings are sho.m in handou'd Table 2 it will hn 

. . — l^::-^* -Ll WLii be Seen 

-a. „HUe a,. as p.„au..e as o„. ^^^^^ 

own _o„a».. „.u u ^^^^^^^^^^ ^^^^^^^^^^^^ _ 

conclusion s.e„s esp.ouu, „„.a„.d „H.„ one' .ecaUs- that .he.e a.e 
onl. a.„„. us SCDEs se.,„„sl,-co„,«ea .o ..0 as a „Us.o„ a.ea. , 
".«.iU be seen that SCDEs .a.e best th. a,.a-„£ j„G„„i 
cat.„„s-tH.. a.„„. „„„ 5. p„ .,„t aU ,/t,.u c.eaUs th. a. cot. ' 
Jou,„ars st„.,e.. otHet „„,„„sU. .uts. .„oIua.„. au t„. soc.a. so.e„ce 

departments .Which are frequently believed to 

H u y Deiieved to be serious competitors for 

SCDES ;„ th. .aucatlona. K.D a«„a. co„t,..ut. less than 8 pe. cent. So^ 
a^scountln. o, this a^ute „„st ol coutse-.^e- ao„e on the , to„„as that ,ae- ' 



«ouW undoubtedly ba gratified to appear. ■ ' ' ' ' 

• '*^"° non-unlverslty sources consttlbute. almost 31 por cent '.I ' 

Journal articles; „bUe £orel-g„ .„urc.s account tor the rc™i„-der-Just „n- 



der 5 per cent. 



Il.e Situation With respect to RIE is interesting in that despite 
the ease of entry, .hich „ost SCDE critics would ta.e to be a basis £or ^ ' 
predicting high SC06 involvement, SCDEs in £act contribute less than 7 per ' 
cent Of entries. By £ar the Urges t- 'proportion co^es £r„. domestic non-Uni- 
^ versi^ty sources, over b8 per cent.' otHc. university depar ^ents-contribute 
-.e. to HXE than do SCHs but they .Iso .all short o. non-„niversity sources ' 
It is clear that aiB, is the mode of co-u„ication a.on'g educational MD per^ - 
, sonnel not associated With institutions, ol, higher education. 
, ■ Among the other" indices, SCDEs typically provide some 40+ per'cenl ' 
m an eases the foreign contribution is small. University ^^is^ .^.^ 
.provide heavily in the boo,, area while non-Univers ity sources predominate 
in convention- papers and foundation grants. ■> ■ , ' ,. 

. ^^ether ,his pontribution f.o. SCDEs "s, seen as^laudable or not de- ^ ' 

pends on. one ' s DersiSpnt-ii^fi ^--i - - , ^ 

v^i-Lug cne very idrge number and variety 

of competitive-agencies, their, performance of a bit over 40 , per cent 'i; most ' 
areas and 56 per cent in Jonrnal articles must be considered except ional, ' ag. in" 
-caUing that only abou. U5 SCDEs are really involved.,, Buf considering that' 

^--ti^M. » .-a in Which almost no other agency ' ' 
,<.e£.nes a prime mission £nr,, itself . the less than half average seems to be ' ^ 



il 



remarkably low. When one considers further that the SCDE contribution is 
.made by fewer than one out of five insti tutions , . it is clear that there is 
a great deal of room for improvement. 



13 



erJc 



Egon'G. Cuba • 
David L, Clark/ 
AERA-4/77 



TABU 1 



■ LEVEL OF R&D PRODUCTIVITY IN SCDEI BY INSTITIITTONAT. TYPR 



Category 



Level of Productivity 



High Producers 



R&D 
Centers 



Other 
Outstanding 
Producers 



m 

Actives 



Unusual 
Producers 



i i-i:.Jdie' 
Range ; 
iToducers 



Low Producers 



Occasional 
Producers 



' Minimal 
Producers 



Idiographic 
Producers 




. Non- 
Producers 



These 14,1 institutions,, while engaged in education personnel training, are excluded from their normal , ■ ■ 
categories because of their speciarpurpose nature, e.g., seminaries, business schools, art' schools etc. 
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■ TABLE 2 



MlIMiCDEs_AMONG'R{<D PRODUCERS^ 




Figures-eatered for SCDES are adjusted for "University' Undesignated", 
SIE data were computed for coUege/university sources '^:^y,, 



entries. 



